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Abstract — Polarity coincidence correlator (PCC), when 
used to estimate the covariance matrix on an element-by- 
element basis, may not yield a positive semi-definite (PSD) 
estimate. Devlin et al. [1], claimed that element-wise PCC 
is not guaranteed to be PSD in dimensions p > 3 for real 
signals. However, no justification or proof was available on 
this issue. In this letter, it is proved that for real signals with 
p < 3 and for complex signals with p < 2, a PSD estimate 
is guaranteed. Counterexamples are presented for higher 
dimensions which yield invaUd covariance estimates. 

Index Terms — Polarity coincidence correlator, element- 
wise covariance estimate, positive semi-definite. 

I. Introduction and Preliminaries 

POLARITY coincidence correlator (PCC) is a robust 
and nonparametric estimator of bivariate correlation 
[1], [2]. It is also a fast and low-cost estimator for 
applications with extraordinary computational complex- 
ity. Radio astronomy is an instance in which PCC is by 
far the most favorable correlator [3]. 

Several researchers have investigated the statistical 
error of PCC as an estimate of bivariate correlation 
[4], [5]. In multivariate case, using PCC to estimate 
elements of the covariance matrix does not guarantee 
a PSD matrix estimator [1], [6]. Devlin et al. [1, Sec. 
4.4], referring to a personal communication, claim that 
element-wise PCC (or "quadrant correlation"), may yield 
an invalid covariance estimate for p > 3 and real signals. 

In this letter, we prove that for real signals with p < 3, 
and complex signals with p <2, PCC estimate is PSD. 
For higher dimensions, counterexamples are presented 
which yield invalid covariance estimates. 

Let X and y be two zero-mean real random variables 
with correlation coefficient r distributed with elliptical 
symmetry. It is well known that [6]: 

r = sin (^^£'{sgn(x)sgn(y)}^ (1) 

This work was supported by Advanced Communication Re- 
search Institute (ACRI), Sharif University of Technology, Tehran, 
Iran. Authors are with the Department of Electrical Engineering, 
Sharif University of Technology, Tehran, Iran (e-mails: farzanhad- 
dadi@yahoo.com, Nayebi@sharif.edu, and Aref@sharif.edu). 



where 

. ^ / +1 : X > ... 

Using ([T]), an estimate of r from N iid observations 
Xi,yi,i = l,...,N is given by 

vr 1 ^ 

^ = sin ^s„Sy,). (3) 

i=l 

where Sxi = sgn(xj). In the complex case, we can define 
the complex sign function as sgn^(x) = sgn(5R[x]) + 
j sgn(9[x]), where 'R[x\ and are real and imaginary 
parts of X, respectively. In the Appendix, it is shown that 

5R[r] = sin(^ii;{5R[sgn,(x)sgn:(y)]}) 

9[r] = sin {^E{^ [sgn,(x)sgn:(y)]}) (4) 

where (•)* denotes complex conjugate. Similar to (|3]l, an 
estimate for the complex case is obtained by replacing 
expectation with the average as 

1 ^ 

rR = sin ^ [sxiRSyiR + SxUSynfj 

i=l 
1 ^ 

fi = sin (^^-^ ^ [sxiiSyiR - SxiRSyii]^ (5) 

i=l 

where {■)r and (•)/ denote real and imaginary parts, 
respectively. 

II. Main Result 

Let Rpxp be the covariance matrix of p random 
signals with unit diagonal elements and off-diagonal 
elements r-ij : i,j = 1, • • • ,p. For p = 2 case, a valid 
correlation estimate should satisfy \r\ < 1. For the real 
case of \f \ = |sin(-)| < 1. For the complex case, 
regarding ^ define a and /? such that vr = sin(a) and 
f / = sin(/3). Then 

N 

01 + 13 = — ^ [SxiR{SyiR - Syil) + Sxil{SyiR + Syil)] 
1=1 

(6) 

and it can be easily checked that the argument of sum- 
mation in Q belongs to {±2}. This yields a+/3 < ^. In 
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Fig. 1. Polarity coincidence diagram of x,y,z. Black strips 
denote the packed positions of polarity coincidences of each signal 
with signal x. The strips lengths Nui are the number of polarity 
coincidences. 

the same manner, we can show that it q it /? < ^ which 
gives |q[ + [/?| < |. Now it is straightforward to see that 
|r|2 = sin2(Q!) + sin2(/?) < sin2(|a|)+sin2(|-|a|) = 1. 

For p = 3 and real signals, we calculate the valid range 
of the elements of a 3 x 3 covariance matrix. Then we 
show that PCC estimate lies in this range. 

A. Valid Range of Covariance 

Let G M^^^ be a covariance matrix with unit diag- 
onal elements. Valid range of r23 should be calculated 
when ri2,ri3 G [— 1,+1] are fixed. It can be readily 
shown that > implies that 

I r23 - ri2ri3 1 < ^(l - rf^) (l - . (7) 

B. PCC Covariance Estimate 

Assume random sign sequences Sx,Sy, Sz with length 
N. Consider the positions of polarity coincidence with 
Sx as black positions or "+" and elsewhere as white 
or "— ". Obviously all of the positions in Sx is "+" 

and {syi,Szi) have four states of {++,H — , — h, }■ 

Since the permutation of the samples does not affect the 
estimate in ([3]l, put the samples of Sx,Sy,Sz from left 

in the order of {+ H — ,+ + +,-{ h, H } as in 

Fig. [T] Then any random sign sequences of Sx, Sy and Sz 
can be replaced by the model in Fig. [T]with appropriate 
strip lengths Nai (with ai = 1) and relative positions of 
strips. 

Let Rs be the covariance matrix of Sx,Sy,Sz with 
elements Vgik, i,k = 1, 2, 3. The maximum of rsi2 = +1 
occurs in a2 = 1 and the minimum of rsi2 = — 1 in 
02 = 0. In fact, rsi2 = ;^ Eili ^xiSyi = jf [Na2 - 
{N — Na2)] = 2a2 — 1, in other words 



rsi2 and rsis are determined by the values of 02 and 
Is, Tsii = 1, and the possible range of rs23 should 
be calculated. rs2i, depends on the number of polarity 
coincidences of y and z which is maximum when the 
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Counterexamples for real and complex data 
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strip of z is in the left comer, and minimum when it is 
in the right corner. After some calculations, the range of 
rs23 is found as 

I rsi2 + rsi3\ - 1 < rs23 < 1 - I rsi2 - TsuI- (9) 

It should be noted that the effect of finite N is the 
quantization of the accessible values. Now, it can be 
readily verified that 



and 




n2ri3 - ^J{l-rl,){l-rl,). (1 1) 

Therefore, f23 = sin rs23) satisfies dV]). This, besides 
|ri2| < 1 and |fi3| < 1 can be used to show that > 
(as in (IT])) and the assertion is proved that for p = 3 and 
real data, PCC estimate is a valid covariance matrix. 

III. Counterexamples 

In this section, some counterexamples are presented to 
show that PCC covariance estimate is not guaranteed to 
be PSD in dimensions p > 3 for real signals and p > 2 
for complex signals. In real data case with p = 4 and 
number of observations = 4, the real sign sequences 
in Table U results in an invalid covariance estimate. After 
simple computations, we will have Vgu = ''s34 = 
and Tsis = rsii = rs23 = ?^s24 = 0.5. The covariance 
estimate will be 

" 1 0.7 0.7 " 
^ _ 1 0.7 0.7 
^ ~ 0.7 0.7 1 

_ 0.7 0.7 1 _ 

with eigenvalues [— 0.4, 1,1,2.4]. Then Ri, with a neg- 
ative eigenvalue, is not a valid covariance matrix. 

We can augment this example to give a counter- 
example for dimension p = 5. Repeat each sign twice 
to have four signals with number of observations 2N. 
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Note that the covariance matrix does not change. Now, 
add a new signal with alternating sign in each sample. 
The covariance estimate will be 



■aug 



Ri 
0^ 1 



where is the 4x1 vector of zeros. As a consequence 
of the structure of Rang, eigenvalues of Ri are also 
eigenvalues of Rang- Therefore, Rang is an invalid co- 
variance matrix. This procedure can continue to produce 
counterexamples for higher dimensions in real data case. 

In case of complex signals, p = 3 and = 2, a 
counterexample is given in Table Jl where " — h" denotes 
— 1 + j. The resulting estimate is 



R 



1 0.7 -J 0.7 
0.7 + j 0.7 1 0.7 -j 0.7 
0.7 + j 0.7 1 



with eigenvalues [—0.4, 1, 2.4] which make R an invalid 
covariance matrix. Augmentation of the complex signal 
set for higher dimensions is similar to the real case, 
except that the new added signal alternates between 
"++" and " — ". 



IV. Applications of the Results 

In this section, we discuss the practical usefulness of 
the main results of this letter which focuses on low 
number of sensors. In the signal processing context, 
covariance estimation often arises in the multi-sensor 
applications where parameters of interest are functions of 
the true data covariance matrix. Although PCC estimate 
of the covariance matrix exhibits attractive features such 
as robustness and extremely low complexity, it cannot 
be guaranteed to be PSD in the applications with large 
number of sensors. 

Selection of the number of sensors in an application 
depends on both nature of the problem and practical 
limitations. In theory, more sensors always results in 
a better estimate, as proved in many cases such as 
direction finding through examination of the Cramer-Rao 
bounds [7]. In practice, complexity issues usually limit 
the number of sensors. Large arrays are used whenever 
performance be of the main importance regardless of 
the cost. In such cases as DOA estimation in military 
environments (radar and sonar), thousands of sensors 
are not uncommon. Nevertheless, most low-cost civil 
applications use very few sensors. In the following, we 
consider some of these applications. 



A. MIMO Communication Systems 

Multiple antenna systems are an integral part of the 
most new wireless communication systems increasing 
user and data capacity (e.g. UMTSAV-CDMA, 802.1 In 
WLAN, 60 GHz WPAN). Multiple antennas can provide 
diversity gain and/or better antenna gain through beam- 
forming in base station and/or handset. Beamformers 
(e.g. conventional or Capon) usually utilize an estimate 
of the array covariance matrix [8], that may be obtained 
using PCC as a power-saving estimator. It is well known 
that performance improvement due to diversity gain re- 
duces as the number of antennas increases. This, besides 
space Unlit on the handset and coupling phenomena have 
resulted in the prevalence of MIMO systems with very 
few (usually 2 to 4) antennas [9], [10]. 

B. Blind Source Separation (BSS) 

BSS has found numerous potential applications in 
the field of audio signal processing [11]. An array of 
microphones is used to gather multiple signal mixtures 
and diverse methods are used to extract signals from 
these observations. A large class of BSS methods use 
real-valued inter-sensor covariances with different time 
lags to estimate the mixing matrix and desired signals 
(e.g. SOBI [12], JADE [13]). This also includes in- 
put signals whitening as a preprocessing that converts 
the convolutive source separation problem to a simpler 
independent component analysis (ICA) problem. This 
family of two-step algorithms is known as AMUSE 
(Algorithm for Multiple Source Extraction). PCC, as 
a fast correlator, can make real-time operation more 
feasible in these methods. For realistic situations where 
we have fewer sensors than sources, underdetermined 
methods are proposed [14]. Many methods are presented 
for the special case of 2 sensors and multiple sources 
(e.g. DUET [15], and [16]), and also quite few sensors 
are common to many realizations of the methods [12], 
[14]. 

Appendix 
Complex PCC 

Let X, y be two zero-mean, unit-variance, and circu- 
larly symmetric complex random variables with indepen- 
dent real and imaginary parts. To prove dU), we expand 
the expectation as 

E{sgn^{x)sgn*{y)} = E{[sgn{xRyR) + sgn(x7y/)] 

+j [sgn{xiyR) - sgn{xRyi)]}.{\2) 
Furthermore, E{xy*} = r implies that 

E{xRyR + xiyi} = tr 

E{xiyR - XRyj} = rj. (13) 
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Circular symmetry of x and y yields 

E{xRyR} = E{xiyi} = vr/ 2 
E{xiyR} = -E{xRyi} = rij 2 (14) 

and E{x\} = E{x\} = E{yl} = E{y]] = \ . Then 
the correlation coefficients will be 

Cor {xR, yR) = Cor {xi,yi) = tr 
Cor {xi, yR) = - Cor {xr, yj) = rj. (15) 

Substituting ([T5]l and ([H) into (O gives 

S{sgn^(x)sgn*(y)} = 4/7r [sin"^(rij) + j sin"^(r/) ] (16) 

which implies (01). 
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